Movement Planning and Imitation by Shaping Nonlinear Attractors

نویسنده

  • Stefan Schaal
چکیده

Given the continuous stream of movements that biological systems exhibit in their daily activities, an account for such versatility and creativity has to assume that movement sequences consist of segments, executed either in sequence or with partial or complete overlap. Therefore, a fundamental question that has pervaded research in motor control both in artificial and biological systems revolves around identifying movement primitives (a.k.a. units of actions, basis behaviors, motor schemas, etc.). What are the fundamental building blocks that are strung together, adapted to, and created for ever new behaviors? This paper summarizes results that led to the hypothesis of Dynamic Movement Primitives (DMP). DMPs are units of action that are formalized as stable nonlinear attractor systems. They are useful for autonomous robotics as they are highly flexible in creating complex rhythmic (e.g., locomotion) and discrete (e.g., a tennis swing) behaviors that can quickly be adapted to the inevitable perturbations of a dynamically changing, stochastic environment. Moreover, DMPs provide a formal framework that also lends itself to investigations in computational neuroscience. A recent finding that allows creating DMPs with the help of well-understood statistical learning methods has elevated DMPs from a more heuristic to a principled modeling approach, and, moreover, created a new foundation for imitation learning. Theoretical insights, evaluations on a humanoid robot, and behavioral and brain imaging data will serve to outline the framework of DMPs for a general approach to motor control and imitation in robotics and biology.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Movement Imitation with Nonlinear Dynamical Systems in Humanoid Robots

This article presents a new approach to movement planning, on-line trajectory modification, and imitation learning by representing movement plans based on a set of nonlinear differential equations with well-defined attractor dynamics. In contrast to non-autonomous movement representations like splines, the resultant movement plan remains an autonomous set of nonlinear differential equations tha...

متن کامل

From visuo-motor self learning to early imitation -a neural architecture for humanoid learning

Bchavior imitation ability will he a key technology for future human friendly robots. In order to understand the principles and mechanisms of imitation, we take B synthet,ic cognitive developmental approach, starting with minimum components and create a system that can learn to imitate others. We developed a visuomotor neural learning system which consists of orientation selective visual moveme...

متن کامل

Nonlinear Dynamical Systems for Imitation with Humanoid Robots

This article explores a new approach to learning by imitation and trajectory formation by representing movements as control policies (CPs) based on a set of nonlinear differential equations with well-defined attractor dynamics. An observed movement is approximated by locally linear models using an incremental locally weighted regression technique. In contrast to non-autonomous movement represen...

متن کامل

Implementation of Mobile Robot by Using Double-Scroll Chaotic Attractors

In the present work, the chaotic motion control of a mobile robot is studied, in order to cover a terrain with unpredictable way. The proposed control strategy is based on a chaotic path planning generator. As a chaotic generator, we have used three different nonlinear dynamical systems, the Chua oscillator, the Lorenz system, and a nonlinear circuit with a nonlinear resistor having an i-v char...

متن کامل

Truncated Horizon Policy Search: Combining Reinforcement Learning & Imitation Learning

In this paper, we propose to combine imitation and reinforcement learning via the idea of reward shaping using an oracle. We study the effectiveness of the nearoptimal cost-to-go oracle on the planning horizon and demonstrate that the costto-go oracle shortens the learner’s planning horizon as function of its accuracy: a globally optimal oracle can shorten the planning horizon to one, leading t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2003